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INTRODUCTION 


from  a collection  of  basis 


with  respect  to  a specified  norm.  Our  results  have  been  strongly 
motivated  by  the  difficult  problem  of  choosing  best  locations 
for  antenna  elements  in  a linear  array.  This  problem,  which 
has  been  considered  in  various  forms  in  the  engineering  litera- 


is  formulated  below  so  that  the  reader  can 


we  formulate  the  partial  basis  problem  precisely,  present  an 
algorithm  for  its  solution,  and  discuss  numerical  results  of 
the  application  of  the  algorithm  to  the  antenna  design  problem 
In  section  3 some  theoretical  results  are  presented. 


The  field  pattern  of  a symmetric  line  array  of  antenna 
elements  with  real  symmetric  element  currents  is  proportional 


where  u - ir  sin6 


6 is  the  angle  measured  from  a normal 
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to  the  array  axis^  = Xj^/(A/2),  X is  the  wavelength  of 
the  design  frequency,  and  Xj^  is  the  distance  of  the  kth 
element  from  the  center  of  the  array.  If  the  array  aperture 
is  constrained  to  be  at  most  A,  say,  then  we  will  have 


0 < Xj^  < 


< ^ A/2  . The  basic  objective  is  to  vary 


the  element  currents  and  locations  to  make  lp(u) 

small  for  u away  from  u=0,  subject  to  the  normalization 
condition  |p(0)|  =1  . We  formulate  this  as  a problem  of 
approximating  an  ideal  function 


f(u)  = 


1 if  0 ^ u £ Uq 
0 if  Uj^<  u ^ 17 


where  0 < u^  £ u^^  < ir  (if  u^  < u^,  we  define  f(Uj^)  = 0 
also) . As  a measiire  of  the  approximation  we  use  an  norm, 

1 < r < "»  , 


II  f " P I I “ { I w (u)  1 f (u)  - p (u)  I ^du  I , 

[0,Uq1  U [Uj^,ir] 


the  most  important  case  being  r = 2 (least  squares  approximation) 
or  a uniform  (minimax)  norm 


If  - p| 


max  w(u)  1 f (u)  - p(u) 


ueIo,UQ]  U [Uj^,irl 


Here  w(u)  is  a continuous  weight  function, often  chosen  to 
be  w(u)  = 1 . 
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Our  formulation  of  the  antenna  design  problem  is  then 

n 


minimize 
^k'  ^k 

II  f(u)  - I 
k=l 

®k  ^k  “ * * 

(5) 

subject  to 

V 

• 

• 

• 

V 

V| 

o 

^n 

and 

^ktl-  ^k  ^ 

> 0,  k = 1, • • • ,n-l 

where  A > 0 is  specified  and  L serves  to  limit  the  aperture 
of  the  array.  The  condition  ^ A prevents  any  two 

elements  from  getting  arbitrarily  close  together.  This 
assumption  is  natural  on  physical  grounds;  furthermore  it  has 


an  important  effect  in  simplifying  the  mathematics. 

An  important  feature  of  our  approach  to  problem  (5)  is 
restricting  the  variables  ^ discrete  set 

T = possible  values,  where 

0 = ~ N > n,  and  i = 1,***,N  - 1 . 

The  most  obvious  choice  for  T would  be  equispaced  points 
t^  = (i-l)L/(N-l) , i = 1,***,N  . The  problem  (5)  now  becomes 

n 

(6)  minimize  | 1 f (u)  - ^ a.  cos  5 u ||  . 

a •••  a k=l  ^ 

^1' 

Since  each  t^  gives  rise  to  a basis  function  cos  t^u  , we 
. think  of  problem  (6)  as  that  of  choosing  a best  partial  basis 

{cos  ; i=  l,*»»,n}  from  the  full  set  of  possible  basis 
functions  {cos  t^u  : i = 1,»*»,N}  to  approximate  the  ideal 
function  f with  respect  to  the  specified  norm. 

I 
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^ . 


2.  THE  ALGORITHM  FOR  THE  PARTIAL  BASIS  PROBLEM 


We  now  extend  the  partial  basis  problem  (6)  for  the 
selection  of  best  antenna  element  locations  and  currents  to 
a more  general  context.  Let  be  linearly  indepen- 

dent basis  functions;  we  wish  to  choose  a best  partial  basis 
consisting  of  n (<N)  of  them  to  approximate  a given  func- 
tion f . The  problem  is  then 


(7) 


n 


minimize 


f - y a.  h. 

j=l 


1 iV 


><  1 < N 
n — 


Assiiminq  we  can  compute  the  error 


n 


min 


f - J a.  h. 

j=l 


for  each  fixed  set  of  basis  functions  h.  ,»**,h.  , problem  (7) 

^1  ^n 


can  be  solved  in  a brute  force  way  by  computing  the  error 


corresponding  to  each  of  the  (JJ)  partial  bases.  However 


the  computer  time  required  might  well  be  prohibitive;  hence  a more 
systematic  method  of  inspecting  the  partial  bases  is  desirable. 

The  algorithm  we  present  is  a direct  generalization  of 
an  algorithm  due  to  Hocking  and  Leslie  [5]  for  selecting  a best 
subset  of  independent  variables  in  a linear  regression  analysis; 
their  concern  was  a least  squares  fit.  The  algorithm  searches 


i 


i 
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I 


for  r = N - n basis  functions  to  delete  from  the  full  set 
of  basis  functions.  We  first  compute  for  i = 1, 


®i  = 


min  I I f - J a^hj 


= error  of  a best  approximation  using  all  basis  functions 
except  . 

To  avoid  cumbersome  notation  we  assume  the  basis  functions 
are  renumbered  so  that  E,  < E_  < • • • < E„  . The  following 
simple  lemma  is  the  principle  upon  which  the  algorithm  is 
based. 


LEMMA  1.  Let  I = {ij^»  • • • ,ij.}  C { 1, . • • ,n}  be  a set  of 

indices  with  largest  element  i^  . If 


(8)  min 

{a^  : iiil} 


f - y a.h.  II  < E.  . - 


then  for  any  subset  I'  C {1,»»*,N}  which  contains  an  index 


i'  > i^  + 1 we  have 


min  . ^ ' N f - I a.h.  | | > min  I I f - I a.h.  | 

{a.  ; i=l  ^ ^ {a.  ; i^fl}  i=l  ^ ^ 

i^I'  ^ 

In  words,  if  inequality  (8)  is  satisfied,  a better  partial 

basis  cannot  be  obtained  by  deleting  a basis  function  with 

index  > i^  + 1 . 

— r 
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Proof.  min 


f - I a.h. I I > min  I |f  - X a. I 
i»l  ^ ^ (a.:i?<i'}  ^ 


Ul' 


Ei.  1 Ei  + 1 1 

^ {a^;i|fl} 


We  now  formulate  the  algorithm. 


I a.h.i 
i=l  ^ ^ 

in 


step  1.  Compute  renumbering  the  basis  functions 


if  necessary.  If 


“r+l' •••'*» 


It  - I a.h. II  < E 

i=r+l  ^ ^ 


then 


by  Lemma  1 with  I = { 1 , • • • , r}  we  see  that  ' * ’ * ' ^ 


a best  partial  basis  cmd  the  algorithm  terminates.  If 

N 

min  I I f - I a.h. | | > E ^ 

a , , , a 4 —..^1  J-  i r-rx 

®r+l' 


i=r+l 


we  proceed  to  Step  2. 


Step  2.  Compute  the  quantities 

min  I If  - J a.hJ  I 
{a. :i^I,}  i=l  ^ ^ 


Where  Ij  consists  of  r of  the  indices  l,*«»,r+l  . 

Let  1 2*  l^e  an  index  set  giving  the  minimum  over  such  index  sets, 


(viSi*)  "'-Ji  ^ 

i M j A 


then  by  Lenuna  1 with  I = a best  partial  basis  is  obtained 


by  deleting  those  basis  functions  with  indices  in  I2*  and  the 


algorithm  terminates.  If 

N 


min  I I f - I a . h . | | > E - 

{a^;i^l2*}  i=l  ^ ^ r+2  , 


i^l2* 


we  proceed  to  the  next  step. 


A general  step  of  the  algorithm  can  be  described  as  follows. 


Step  q.  Compute  the  quantities 


min  l|f  - I a.h. I 
{a.  :i«fl  } i=l  ^ ^ 


where  consists  of  exactly  r of  the  Indices  l,»»*,r  + q - 1 


Let  be  an  index  set  giving  the  minimum  over  such  index  sets. 


n 

min  Ilf-  y a.h. II  < 
{a,:i^I*}  i=l  1 1"  - r+q  , 


1 q 


then  by  Lemma  1 with  I = I * a best  partial  basis  is  obtained 

'd 


by  deleting  those  basis  functions  with  indices  in  1^*  . If 


I I f - i a.h.  | | > E 

{a, :i^I  *}  i=l  ^ ^ 


i^I  * 

q 


the  algorithm  proceeds  to  the  next  step. 


Of  course  the  algorithm  will  either  terminate  at  some  step 
with  a best  partial  basis  or  continue  to  search  all  partial  bases; 
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hence  a best  partial  basis  will  be  obtained.  The  value  of  the 

alqorithiTi  is  in  identifyinq  a best  partial  basis  after  havinq 

N 

searched  only  a fraction  of  the  (^)  possibilities. 

We  have  written  a FORTRAN  computer  program  to  implement 
the  algorithm  for  the  antenna  design  problem.  It  is  presently 
capable  of  doing  weighted  least  squares  problems;  we  plan  to 
extend  it  to  solve  minimax  problems.  As  an  illustration  of  the 
procedure  consider  the  following  example. 


1 if  0 u .1 
0 if  .15  < u < .5 


The  problem  is  to  choose  9 out  of  the  21  basis  functions 
cos  2irk.u,  k = 0,1, ••*,20,  to  best  approximate  f(u)  in  the 
least  squares  norm 

I I f (u)  - p (u)  I I = I Jl  f (u)  - p (u) I ^du|^^^  . 

[0, .1]  u [.15, .5] 

2 

To  avoid  square  roots,  we  actually  work  with  | |f  - p| | 

The  algorithm  identifies  a best  partial  basis  consisting  of  the 
basis  functions  corresponding  to  k = 0,1,2,3,5,6,7,9,10; 
notice  this  gives  a much  smaller  aperture  than  the  maximum 
allowable.  A best  partial  basis  is  actually  attained  in 
Step  2,  although  it  cannot  be  identified  as  such  by  the 
algorithm  until  after  Step  3.  The  algorithm  examines  only 


r + q - 1 
r 


14l 

12 


= 91 


partial  bases  out  of  the 


possible 


'21 

9 


273,930. 


It  should  be  noted,  however. 
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that  the  algorithm  works  exceptionally  well  for  this  example 
because  the  basis  functions  are  nearly  orthogonal. 

EXAMPLE  2.  For  f (u)  as  in  Excunple  1,  the  problem  is  to 

choose  4 out  of  the  21  basis  functions  cos  2Trk(.l)u, 

k = 0,  1, • • • , 20,  to  minimize 

f 4 ,42 

I [f(u)  - ^ a cos  2TTk.  (.l)u]  + (.01)  I a. 

J j=l  ‘'j  3 k. 

[0, .1] u [.15, .5] 

This  criterion  has  the  desirable  effect  of  controlling  the 
size  of  the  coefficients;  also  numerical  difficulties  due 
to  ill-conditioning  are  reduced.  The  algorithm  identifies 
I cos  2ir(.7)u,  cos  2ir(.8)u,  cos  2ir(1.6)u,  cos  2ir(2)u  as  a best 

I partial  basis  after  Step  4 after  examining  1140  out  of  the 

I possible  5985  partial  bases. 

Figure  1 shows  p(u)  corresponding  to  a best  partial 

basis  for  Example  1. 

In  [6]  an  improvement  of  the  Hocking-Leslie  algorithm 
is  given;  this  modification  can  be  incorporated  into  our 
algorithm  as  well. 
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3 . THEORETICAL  RESULTS 


In  this  section  we  state  and  prove  a "continuous  dependence" 
theorem  and  an  existence  theorem  and  apply  them  to  the  antenna 
design  problem.  The  following  lemmas  will  be  used  in  proving 
the  theorems.  We  will  use  the  notation 

I I a I ll  = II  Ml  = l®il 


t 


for  the  Aj^-norm  of  an  n-vector  of  real  numbers. 
LEMMA  2.  Let  X be  a real  normed  linear  space  with 


i 

1 norm 

! 

ll-IM 

f 

in 

X,  lim  1 1 a 
k-^-oo 

- a"»|li  = 0 . 

P 

i and 

i 

J 

lim 

k->-t» 

0 
II 

o 

-H 

Xi 

1 

for  i = 1, • • • ,n 

where 

1 

in 

X, 

i * 1, • • • ,n; 

k = 0,  !,•••  . 

Then  lim 
k-voo 


Proof . 


(k)  (k) 


- ^i  ^ ^'i 

i=l  ^ ^ 

(k).  (k) 


f - I a 

i=l  ^ ^ 

(k)^  (k) 


If-  i a.<0>h.<0) 
i=l  ^ ^ 


f-  I a.(0)h.<0) 

xtl  ^ ^ 


< ||(f  - I a '^^'h  - (f-  I a <0)h  <°M|| 

i=l  ^ ^ i=l  ^ ^ 

= II  I I II 

i=l  ^ ^ i=l  ^ ^ 


ai  (h.  -h. 


n 


(k)  , (O)a  . (0) 


+ II  E h.' 

i=l  ^ 1 1 
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i! 


i 


The  conclusion  of  the  lemma  now  follows  since  the  convergent 

I _ (k)  I I 


sequence 


is  bounded. 


LEJ4MA  3.  If  lim  | Ih.  - h. 

k-H»  ^ 


= 0,  i = l,***,n^  where  h^ 


(k) 


are  in  the  real  normed  linear  space  X for  i = l,»**,n; 
k = 0,  I,***;  are  linearly  independent, 

i-(k)M  __ 


and  lim 

k-w 

is  unbounded. 
Proof . Assume 


then  (III  a.  ^^^h.  ! sk  = 1, 

i=l  ^ ^ 


(k).  (k)  I I is  bounded. 


II  I a 

i=l  ^ ^ 

The  sequence  a^^V|  1^  bounded  and  hence  has  a 


(k  ) (kj 

convergent  subsequence  a /I  I a 


having 


(0) 


^ with  limit,  say,  a 
n (k„)  (k 


n 


n (k„)  (k„.  / 

II  =1  . Then  0 = lim  I I I a.  ” h.  "‘Ml/I 
^ ^ m-H»  i=l  ^ ^ ' 


(0) 


m 


= lim  II  I 
m-H»  i=l 


a. 

1 


m 


n 


I y a/®^h.  I I by  lemma  2. 

'i£l  1 1 " 


n 


Hence  7 a.'^^h.'®  = 0 which  contradicts  the  linear 

i=l  ^ ^ 

independence  of  ^^^ ' * * * completes  the  proof  of 

the  lemma . 

Our  first  theorem  concerns  the  continuous  dependence  of 
a best  approximation  on  the  basis  functions. 

THEOREM  1>  Let  X be  a real  normed  linear  space,  f e X, 


and 


linearly  independent  in  X . 


lui  -r  jirfJT-,- 
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Let  d 


Then 


(0)  _ 


(0)^  (0) 


f-  I 

i=l  ^ 


^'***'^n 


I a.h. 
i=l  ^ ^ 


(i)  If  ^'***'^n  ^ l|h^  " ^ I I < ^ » 

i = 1, • • *,n  then  +6*^  |a.^®^| 

i=l  ^ 


where  d = inf 

ai,...,an 


f - a.h. 

iix  ^ ^ 


(ii)  Given  e > 0 there  exists  8 > 0 such  that 


if  are  in  X and  ||h^-h^^°^|l  < 6 ,i=l, • • • ,n, 

then  d^®^  ~ e < d . 

iii)  If  Y a.  ^®^hi  is  a unique  best  approximation  to  f by 

i=l  ^ ^ — 

linear  combinations  of  h,^®i**«,h  then  given  e > 0 there 

J.  n 

exists  6 > 0 such  that  if  h, f»*»,h  are  in  X and 

1 n 

II  < 6 , i m !,•••, n, 

we  have  | a^  - a^ ^°^ | < e , i = l, • • • ,n. 


where 


f - y a.h. 
i=l  ^ ^ 


aj^,  • • • ,a^ 


f - I a^h.l  I. 

i=l  ^ ^ 


Proof.  (i)  d = inf 


= inf  ||f-  I a^h^MlIlf-  I a.^°^h.|| 
^l'’”'^n  i=l  ^ ^ 

= l|(f-?  a.(0)h,(°>)  . I a,(0)(h,(°>  -h,)|| 

i=l  ^ ^ i=l  ^ ^ ^ 

i ll£-.?a,<«'h,«»||  . I |a,'»'|.||h,<»'-h,|i 

1=1  i=l  ^ ^ ^ 


^ d' 


+ I I a. 

i=l  ^ 


j 
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(ii)  Assume  (ii)  is  false.  Then  there  exist  e > 0 , 
h^^^^  in  X,  k = 1,  with 

lim  ||h.  - h.^^^ll  = 0,  i = !,•••, n,  and 

k-oo  1 1 

a^^\  k = 1,  such  that 

Ilf  - j a, O'*  I I id<»>  -e  . 


By  lemma  3,  I la'  M 1 is  bounded  and  hence  (a'  M 

(k  ) 

has  a convergent  subsequence,  say  {a  },  with 
limit,  say,  a*  . Then 

d“»-  e > Ita  Ilf  - ? .||£-?  aj  h '“' | 1 

m-H*.  i=l  ^ ^ i=l  ^ ^ 

> d^®\  a contradiction. 


CLii)  If  the  conclusion  of  (iii)  is  false,  then  there 


exist  h. with  lim  | jh.  - h. 

^ k-^oo  ^ ^ 


= 0,  i=l, •• *,n. 


and  a 


with  llf-!a.'>'>h<’'>tl 
iii  1 1 


. Inf  Ilf  - I a.h  '"Ml  <11  f II 

a, , • • • ,a  i=l 

X n 

such  that  1 I a - a | | ^ e for  k = 1,  2,  • • •, 


By  lemma  3,  | |a 


is  bounded  and  hence  {a'  '} 


/ 

has  a convergent  subsequence  {a  -*  } with  limit,  say,  S. 
n n (k.)  (k.) 

Then  1 1 f - I S.  h.  1 = li"*  I I f " I a . ^ h.  ^ | 1 

i*l  j-^-"  i=l 

= d^®^  by  (i),  (ii) . This  contradicts  the 
uniqueness  of  a^^^  and  completes  the  proof  of  the 
theorem . 
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We  now  wish  to  prove  an  existence  theorem  for  the 
generalization  of  problem  (5)  in  section  1.  The  following  ] 

hypotheses  will  be  useful.  I 


HI.  X is  a real  normed  linear  space  with  norm  | | *11 
and  f e X . 

H2.  h(u,  C)  is  a real  function  on  [a^,  02!  x 82! 

such  that  for  each  5 in  [Bj^ , 82! » h ( • , O is  in  X. 

H3.  For  any  <•••<  ± functions 

h(u,  f • • • ,h  (u,  are  linearly  independent. 

H4.  There  exists  K > 0 such  that  for  any  ?,n  in  [Bj^,B2l 

I |h(u,C)  - h(u,  n)  1 I < K • U - n I . 

H5.  Notation;  T.  = {(5  ,•••,?  ) : B,  < C,  < Bo» 

“ X n ± — 1 n — z 

1 i=l,»**,n-l} 

(Bo  _ B,) 

for  0 < A ^ — (so  that  T^  is  nonempty)  . 

THEOREM  2 (EXISTENCE).  Assume  H1-H5.  Then  there  exist 

/V 

and  C e T^  such  that 

, " o n 

||f(u)=  I a.  h(u,  Ci)||=  inf  I |f(u)  - ^ a.  h(u,C. ) I 1. 

i=l  aw  • • • ,a  i=l 

X n 

C e T^ 


Proof.  Let  e T^  be  such  that 

lim  I If  - a.  ^^^h(u,  ) I I = inf  I | f (u)  - I a.  h(u,C. ) | 1 

1^-"“  i=l  ^ ^ a,  ,---,a„  i=l  1 ^ ' 

X n 

Since  T^  is  compact,  there  exists  a convergent  subsequence 

(^4^  (k)  '' 

C of  C , with  limit,  say,C  in  T^.  Using  H4  we  see  lemma  3 

applies  with  h^  =h(u,  q^^^)  and  so 

(k.  ) 

is  bounded.  Letting  a ***  be  a convergent  subsequence 
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with  limit  a we  obtain 


If  - y a. 

iii  ‘ 


(k  , 


h(u,4. 


(k  ) 

m 


Ilf  - y a h(u,L) 

i=l  ^ ^ 


by  lennia  2,  which  completes  the  proof  of  the  theorem. 

We  now  examine  the  implications  of  Theorems  1 and  2. 

Theorem  2 guarantees  the  existence  of  best  element  locations 

0<  ?,  *<•••<?*<!*  and  currents  a,  *,•••,  a * for 
problem  (5);  this  follows  by  taking  h(u,  = cos 

Theorem  1,  part  (i)  , guarantees  that  if  0 1 < * * * < ^ L 

satisfy  | | < y » there  is  a constant  C such  that 

(9)  d < d < d*  + C-Y  I |a/l 

i=l  ^ 


■ 


where  d = inf 

ai,.“,a^ 


f - y a.  cos  C-u| 

dl  ^ 


d*=  ||f  - y a.*  cos  C.*u||,  and  11*11 
i=l  ^ ^ 

is  of  the  form  (3)  or  (4)  in  section  1. 

We  can  interpret  inequality  (9)  as  giving  a bound  on 
the  deviation  of  a best  approximation  to  f using  element 
locations  which  are  not  optimal  (not  a solution  of  problem  (5)); 
suboptimal  locations  could  result  from  the  discretization  of 
possible  locations  introduced  at  the  end  of  section  1 . 

Inequality  (9)  can  also  be  interpreted  as  bounding  the  change 
in  the  deviation  due  to  a perturbation  in  the  element  locations, 
which  might  occur  physically. 
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